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BACKGROUND OF THE INVENTION 

The present invention relates in general to a 
storage apparatus system for carrying out the copy (the 
remote copy) of data to another storage apparatus 
5 system which is located in an out-of-the-way place. 
More particularly, the invention relates to an infor- 
mation processing system for carrying out the remote 
copy which is of the type in which the order of writing 
data from a host computer to a storage apparatus system 

10 does not match the order of transmitting data from a 
storage apparatus system having the data written 
thereto to another storage apparatus system. 

In an information processing system having a 
host computer and a plurality of storage apparatus 

15 systems, as the technology of carrying out the copy of 
data between the storage apparatus systems, there is 
known the remote copy. 

By the remote copy is meant the technology in 
which a plurality of storage apparatus systems which 

20 are located physically apart from one another carry out 
the copy of the data, i.e., the double writing of the 
data between the storage apparatus systems without 
interposition of the host computer. 

The storage apparatus system is a system 

25 including a plurality of storage apparatuses and a 



controller for controlling these storage apparatuses. 

In the information processing system which 
carries out the remote copy, the storage apparatus 
systems which are respectively arranged in the places 
5 physically remote from one another are electrically 
connected to one another through dedicated lines or 
public lines. Of logical storage areas (hereinafter, 
referred to as "logical volumes", when applicable) 
which a certain storage apparatus system has, the 

10 logical volume having the same capacity as that of the 
logical volume subjected to the remote copy 
(hereinafter, referred to as "the source volume" for 
short, when applicable) is ensured in the storage 
apparatus system to which the logical volume as the 

15 source of the copy is copied. This ensured logical 
volume (hereinafter, referred to as "the destination 
volume", when applicable) is formed in such a way as to 
show one-to-one correspondence relation with the 
logical volume as the source of the copy. 

20 The data of the logical volume as the source 

of the copy is copied to the logical volume as the 
destination of the copy through the associated one of 
the dedicated lines or public lines. 

When the data contained in the logical volume 

25 as the source of the copy is updated, the updated data 
is transferred to the storage apparatus system having 
the logical volume as the destination of the copy 
through the associated one of the dedicated lines or 
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the like and the updated data is also written to the 
logical volume as the destination of the copy corre- 
sponding to the logical volume as the source of the 
copy. 

5 if the technique of the remote copy is 

employed, then in the information processing system 
having a plurality of storage apparatus systems, the 
logical volume of the same contents can be held in a 
plurality of storage apparatus systems. 

10 The technique relating to the remote copy is 

disclosed in U.S. Patent No. 5,742,792. In U.S. Patent 
No. 5,742,792, the technique called the adaptive copy 

is further disclosed. 

By the adaptive copy is meant one of the 
15 remote copy techniques. The adaptive copy is the 

remote copy method wherein before the data written from 
the host computer to the local storage device is copied 
to the remote storage device, the information exhibit- 
ing the completion of write is returned back to the 

20 host computer. 

in the adaptive copy, the transmission order 

of data is not serialized, and hence the order of 
writing the data to the logical volume as the source of 
the copy by the host computer may be different from the 
25 order of transferring these data to the logical volume 
as the destination of the copy in some cases (herein- 
after, such remote copy is referred to as the remote 
copy of "no guarantee to order", when applicable). 
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When the host computer writes repeatedly data 
to the same location in the destination volume on the 
basis of that property, only the data which has been 
written thereto lastly can be transmitted to the 
5 storage apparatus system having the logical volume as 
the destination of the copy. Therefore, the load on 
the network such as the dedicated line between the 
storage apparatus systems can be reduced. 

On the other hand,, when the host computer in 
10 which the file system used in the so-called open system 
is incorporated writes the data to the storage 
apparatus system, in general, the buffer and the like 
provided in the host computer, whereby an instruction 
to transfer the data from an application program to the 
15 file system is made asynchronously with the operation 
of writing the data to the storage apparatus system. 

But, in the case that the data in the file is 
destroyed due to various problems, in order to keep the 
coherency of the file system structure, with respect to 
20 at least the directory and the meta-data such as i-node 
which are used to manage the file system, the operation 
of issuing an instruction to transfer the data, i.e., 
the directory and the meta-data from the host computer 
to the storage apparatus system is carried out 
25 synchronously with issuing of the write command from 

the application program running on the host computer to 
the file system. The above-mentioned technique is 
disclosed in an article of "The Design and 



- 5 - 

Implementation of a Log-Structured File System" , Mendel 
Resenblum and John K. Ousterhout, ACM Transactions on 
Computer Systems, Vol. 10 , No, 1, February 1992, page 
29. 

By executing such a processing, even if the 
data in the file which is buffered in the host computer 
is lost due to the asynchronous writing by an abrupt 
power source shutdown or the like, the meta-data is not 
lost at all. So, the coherency of the file system 
structure is kept and the damage can be kept to a 
minimum even though the data itself is lost. 

SUMMARY OF THE INVENTION 

The remote copy of no guarantee to order is 
carried out, whereby the load which is applied to the 
15 network of the dedicated line or the like distributed 
between the storage apparatus systems can be reduced. 

However, in the remote copy of the order no 
guarantee based on the prior art, it is not taken into 
consideration up to the coherency of the meta-data in 
20 the destination volume to keep the coherency of the 
file system structure, and hence there is the danger 
that a large amount of files would be lost. 

More specifically, in the case where the data 
which has been written to the logical volume as the 
25 source of the copy by the file system is not trans- 
ferred to the logical volume as the destination of the 
copy synchronously with the operation of writing the 
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data to the file system, with respect to the directory 
structure of the storage apparatus system having the 
logical volume as the destination of the copy, the file 
system of the host computer may not become the -state 
5 which is intended in some cases. 

Under above circumstance, the data of the 
storage apparatus system having the logical volume as 
the source of the copy is destroyed, even if the file 
system recovery program such as fsck runs for the 

10 storage apparatus system having the logical volume as 
the destination of the copy, it does not function 
effectively, and as a result the possibility that many 
files are lost is high. Because, the fsck with on the 
basis of the assumption that there is no contradiction 

15 between the directory structure of the storage 

apparatus system having the source volume and the 
directory structure of the storage apparatus system 
having the destination volume. 

In the light of the foregoing, the present 

20 invention has been made in order to solve the above- 
mentioned problems associated with the prior art, and 
it is therefore an object of the present invention to 
provide means for even when carrying out the remote 
copy of the no guarantee to order, keeping the 

25 coherency of the file system structure in the destina- 
tion volume, so that even when the data in the source 
volume is destroyed, the data in the source volume is 
recovered from the destination volume by maintaining 



the coherency of the source volume. 

In order to attain the above-mentioned 
object , according to the present invention, there is 
provided a storage apparatus system having a host 
computer, a main storage apparatus system and a 
substorage apparatus system which is electrically 
connected to the main storage apparatus system, wherein 
an instruction is transmitted from the host computer to 
the main storage apparatus system in such a way as to 
maintain the data of the main storage apparatus system 
at a time point when the instruction is issued and the 
fixed data is copied to the substorage apparatus 
system. 

In addition, the storage apparatus system may 
also be configured in such a way that the data which is 
maintained in the main storage apparatus system is 
transferred to the substorage system, and after comple- 
tion of the transfer of the maintained data, a signal 
exhibiting the completion of the transfer of the data 
is transferred from the main storage apparatus system 
to the sub-storage apparatus system, so that with the 
reception of the signal exhibiting the completion of 
the data transfer as a turning point, the data is 
structured in the substorage apparatus system. 

In addition, the step of maintaining the 
state of the data is to store the data in a first 
storage area of the main storage apparatus system until 
the instruction is issued from the host computer to 
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copy, after the instruction has been issued from the 
host computer, the data which was stored in the first 
storage area at a time point of the issue of the 
instruction to a second storage area of the main 

5 storage apparatus, and in the step of transferring the 
data, the data which has been copied to the second 
storage area can also be transferred to the sub-storage 
apparatus system. 

In addition, in the step of structuring the 

10 data, the maintained data which has been transferred is 
stored in a third storage area of the substorage 
apparatus system so that using the data which is held 
in the third storage area, the maintained data can also 
be structured in a fourth storage area of the sub- 

15 storage apparatus system. 

Also, according to the present invention, 
there is provided a storage apparatus system including: 
a main storage apparatus system which has a first 
storage area, a second storage area and a main disk 

20 controller and which is electrically connected to a 

host computer; and a substorage apparatus system which 
has a third storage area, a fourth storage area and a 
sub-disk controller and which is electrically connected 
to the main storage apparatus system, wherein the main 

25 disk controller includes: means for recording data 

which has been sent from the host computer in the first 
storage area until an instruction is issued from the 
host computer; means for in response to the instruction 



issued from the host computer, copying the data which 
is recorded in the first storage area to the second 
storage area; and means for sending the copied data to 
the substorage apparatus system. Then, the sub-disk 
5 controller includes: means for receiving the data sent 
thereto to hold the received data in the third storage 
area; and means for structuring the data, which is held 
in the first storage area at a time point when the 
instruction has been issued from the host computer, in 

10 the fourth storage area using the data which is held in 
the third storage area. 

According to another aspect of the present 
invention, the host computer issues a freezing instruc- 
tion to the storage apparatus system as the destination 

15 of the data transfer, and the storage apparatus system 
as the source of the data transfer transfers the data, 
which is held in the storage apparatus system at a time 
point of the issue of the freezing instruction, and the 
arrangement thereof (hereinafter, referred to as "the 

20 volume image" for short, when applicable) to the 

storage apparatus system as the destination of the data 
transfer. All data transfer completion is reported 
which means that the volume image at a time point when 
the freezing instruction has been issued has already 

25 been transferred to the storage apparatus system as the 
destination of the data transfer. 

In the storage apparatus system as the 
destination of the data transfer, the data of the 
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volume image, at a time point of the issue of the 
freezing instruction, in the source of the data 
transfer is held, and when the report exhibiting the 
completion of the data transfer will be made next time, 
the volume image will be updated using the transferred 
data. 

As a result, when the disk unit system in the 
source of the data transfer at an arbitrary time point 
has become unusable, it is possible to utilize the 
volume image which is held in the storage apparatus 
system as the destination of the data transfer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects as well as 
advantages of the present invention will become clear 
15 by the following description of the preferred embodi- 
ments of the present invention with reference to the 
accompanying drawings, wherein: 

Fig. 1 is a block diagram showing a configu- 
ration of a computer system to which a first embodiment 
2 0 of the present invention is applied; 

Figs . 2A to 2C are respectively schematic 
views useful in explaining the flow of the data in the 
first embodiment; 

Fig. 3 is a block diagram showing an internal 
25 configuration of a DKC; 

Fig. 4 is a flow chart useful in explaining 
the write processing in the first embodiment; 



5 



10 
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Fig. 5 is a flow chart useful in explaining 
the main remote copy processing in the first embodi- 
ment; 

Fig. 6 is a flow chart useful in explaining 
5 the sub-remote copy processing in the first embodiment; 

Fig. 7 is a flow chart useful in explaining 
the main freezing processing in the first embodiment; 

Fig. 8 is a flow chart useful in explaining 
the sub-freezing processing in the first embodiment; 
10 Fig. 9 is a flow chart useful in explaining 

the sub-recovery processing in the first embodiment; 

Fig. 10 is a flow chart useful in explaining 
the reading processing in the first embodiment; 

Fig. 11 is a schematic view useful in 
15 explaining the flow of the freezing instruction corre- 
sponding to the first embodiment; 

Fig. 12 is a block diagram showing a 
configuration of a computer system to which a second 
embodiment of the present invention is applied; 
20 Figs. 13A to 13D are respectively schematic 

views useful in explaining the flow of the data in the 
second embodiment; 

Fig. 14 is a schematic view useful in 
explaining the flow of a freezing instruction in the 
25 second embodiment; 

Fig. 15 is a flow chart useful in explaining 
the write processing A in the second embodiment; 

Fig. 16 is a flow chart useful in explaining 
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the main freezing processing A in the second embodi- 
ment; 

Fig, 17 is a flow chart useful in explaining 
the sub-remote copy processing A in the second embodi- 
5 ment ; 

Fig, 18 is a flow chart useful in explaining 
the sub-freezing processing A in the second embodiment; 

Fig. 19 is a block diagram showing a configu- 
ration of a computer system to which a third embodiment 
10 of the present invention is applied; 

Figs. 20A to 20D are respectively schematic 
views useful in explaining the flow of the data in the 
third embodiment; 

Fig. 21 is a schematic view useful in 
15 explaining the flow of a freezing instruction in the 
third embodiment; 

Fig. 22 is a flow chart useful in explaining 
the main write processing B in the third embodiment; 

Fig. 23 is a flow chart useful in explaining 
20 the main freezing processing B in the third embodiment; 

Fig. 24 is a flow chart useful in explaining 
the main copy processing B in the third embodiment; 

Fig. 25 is a flow chart useful in explaining 
the main remote copy processing B in the third embodi- 
2 5 ment ; 

Fig. 26 is a flow chart useful in explaining 
the main freezing completion processing in the third 
embodiment ; 
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Fig, 27 is a flow chart useful in explaining 
the sub-freezing processing in the third embodiment; 
and 

Fig. 28 is a flow chart useful in explaining 
5 the sub-remote copy processing B in the third embodi- 
ment; 



DESCRIPTION OF THE EMBODIMENTS 

The preferred embodiments of the present 
invention will hereinafter be described in detail with 

10 reference to the accompanying drawings. 

Fig. 1 is a block diagram showing a configu- 
ration of a first embodiment of a computer system 1000 
to which the present invention is applied. 

The computer system 1000 includes a host 

15 computer 1010, a main storage apparatus system 1180 f a 
substorage apparatus system 1190 for carrying out the 
remote copy between the main storage apparatus system 
1180 and the sub-storage apparatus system 1190, a sub- 
host computer 1020 and a network 1050 through which the 

20 main storage apparatus system 1180 and the sub-storage 
apparatus system 1190 are linked to each other. 

The substorage apparatus system 1190 is used 
when the main storage apparatus system 1180 becomes 
unusable due to the calamity or the like. The sub-host 

25 computer 1020, when the host computer 1010 or the main 
storage apparatus system 1180 becomes unusable, takes 
over the processing which the host computer 1010 is 
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expected essentially to execute, using the data in the 
sub-storage apparatus system 1190. 

For the network 1050, it is assumed that it 
is the shared network such as the Internet, and the 
5 transfer rate of the data is not so high* In the 

present embodiment, it is assumed that the remote copy 
between the main storage apparatus system 1180 and the 
substorage apparatus system 1190 is carried out with 
the no guarantee to order while no heavy load is 
10 applied to the network 1050* By the way, the data 

transfer rate of the network 1050 may be high as well* 

The main storage apparatus system 1180 
includes a main disk unit 1130 in which the data trans- 
ferred from the host computer 1010 is stored, and a 
15 main disk controller 1030 (hereinafter, referred to as 
"a DKC" for short, when applicable) for controlling the 
main disk unit 1130. 

In the present embodiment, the host computer 
1010 issues an instruction to the main storage appara- 
20 tus system 1180 in such a way as to carry out "the 
freezing" (hereinafter, referred to as "the freezing 
instruction" when applicable). 

The meaning of "the freezing" is to hold, for 
the substorage apparatus system 1190, the same volume 
25 image as that of the main storage apparatus system 1180 
at a time point when the host computer 1010 has issued 
the instruction. 

The main disk unit 1130 includes a main 



volume 1120 and a main differential volume 1140. Each 
of the main volume and the main differential volume may 
be either the logical volume or the physical volume. 
In the case of the logical volume, as in the present 
5 embodiment , a plurality of volumes may be present in 
the main disk unit in some cases. On the other hand, 
in the case of the physical volume, the main disk unit 
further includes a plurality of disk units each of 
which constitutes the physical volume. In addition, in 

10 the case as well of the logical volume, the main disk 
unit may be constituted by a plurality of disk units. 

In the main volume 112 0, there is stored the 
data which has been transferred from the host computer 
1010 to the main storage apparatus system 1180. 

15 In the main differential volume 1140, for a 

time period ranging from a time point when the main 
storage apparatus system 1180 has received the freezing 
instruction from the host computer 1010 up to a time 
point when the processing of the freezing has been 

20 completed (hereinafter, such a time period is referred 
to as "in the freezing" for short, when applicable), 
there is stored the data which has been transferred 
from the host computer 1010. 

The main DKC 1030 has a main freezing mode 

25 1060, a main bitmap 1070 and a main differential bitmap 
1080 on the memory. 

The main freezing mode 1060 shows whether or 
not the main DKC 1030 itself is executing the process 



of the freezing. For example, if it is judged that the 
main DKC 1030 itself is executing the processing in the 
freezing, then the mode becomes 1. 

The main bitmap 1070 and the main differen- 
tial bitmap 1080 have the respective bits each 
corresponding to a block which the main volume 1120 
has • 

The main bitmap 1070 shows the blocks in the 
main volume 112 0. These blocks are the data, which are 
not yet transferred to the sub-DKC 1040, among the data 
stored in the main volume 1120 before the main storage 
apparatus system 1180 receives the freezing instruction 
from the host computer 1010. 

The main differential bitmap 1080 shows the 
blocks which contain the data which the main disk unit 
113 0 has received from the host computer 1010 while the 
main DKC 1030 is executing the process of the freezing. 

The data is stored in the log-structured 
postscript type file format in the main difference 
volume 1140. The block numbers exhibiting correspond- 
ing blocks in the main volume 1120 are also contained 
in the stored data. 

In the case where the write data to be 
written to the main volume 1120 is received while the 
main DKC 103 0 is executing the process of the freezing, 
the main DKC 103 0 checks the main differential bitmap 
1080. When the write data to be written has already 
been present in the main differential volume 1140, the 
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data which was written to the main differential volume 
1140 prior thereto is cancelled in such a way that a 
plurality of data written to the same block are not 
present in the main differential volume 1140 • 
5 The substorage apparatus system 1190 includes 

a sub-disk unit 1160 in which the data which has been 
remote-copied from the main storage apparatus system 
1180 is stored, and a sub-DKC 1040 for controlling the 
sub-disk unit 1160 • 

10 The sub-disk unit 1160 includes a sub-volume 

1150/ a sub-differential volume A 1170 and a sub- 
differential volume B 1175. 

In the sub-volume 1150, there is stored the 
volume image of the main volume 112 0 at a certain time 

15 point, more specifically, at a time point when the host 
computer 1010 previously issued the freezing instruc- 
tion to the main storage apparatus system 1180. 

In the sub-differential volume A 1170, there 
is stored the data which was written to the main 

20 storage apparatus system 1180 on and after the host 
computer 1010 previously issued the freezing instruc- 
tion to the main storage apparatus system 1180. 

The blocks of the sub-volume 1150 and the 
main volume 1120 show one-to-one correspondence. 

25 The sub-DKC 1040 includes a sub-freezing mode 

1090, a sub-bitmap 1100 and a sub-differential bitmap 
1110 on a memory (not shown). 

The value of the sub-freezing mode 1090 
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becomes zero when the sub-DKC 1040 does not execute the 
process of the freezing, and becomes 1 or 2 when the 
sub-DKC 1040 is executing the process of the freezing. 

The sub-bitmap 1100 and the sub-differential 
5 bitmap 1110 are constituted with the same number of 
bits as the number of blocks which the sub-volume A 
1150 has, and 1 bit corresponds to 1 block. 

The sub-bitmap 1100 shows the presence or 
absence of the data which is stored in the subdifferen- 

10 tial volume A 1170. 

The sub-differential bitmap 1110 shows the 
presence or absence of the data which is stored in the 
sub-differential volume B 1175. 

The data is respectively stored in the log- 
15 structured type file format in the sub-differential 
volume A 1170 and the sub-differential volume B 1175 
similarly to the main differential volume 1140. The 
block numbers exhibiting the corresponding blocks in 
the sub-volume 1150 are also contained in the data 
20 which is respectively stored therein. 

The sub-DKC 104 0 executes the same processing 
as that in the main DKC 1030 to cancel the old data in 
such a way that two or more data corresponding to the 
same block is not present in the sub-differential 
25 volume A 1170 and the sub-differential volume B 1175. 

While in the present embodiment, the host 
computer 1010 issues the freezing instruction, 
alternatively, the main DKC 1030 or the sub DKC 1040 



- 19 - 

may issue the freezing instruction. 

The application program which runs on the 
host computer 1010 issues an instruction to write data 
to the main storage apparatus system 1180. But, in 
5 actuality, there may be the case where the data is 
written to the cache or buffer memory of the host 
computer 1010 and hence the contents of the data stored 
in the main storage apparatus system 1180 become the 
state which the application program does not intend 

10 (i.e., the data which ought to have been written is not 
yet written in actual). 

If under this state, the host computer 1010 
has gone down due to a shutdown of the power source, 
and the file system recovery program such as fsck is 

15 executed for the main storage apparatus system 1180, 
then there is the possibility that the data which is 
not reflected in the main storage apparatus system 1180 
may be lost. 

In order to prevent the data which is not 

20 reflected in the main storage apparatus system 1180 
from being lost, the main DKC 1030 or the like should 
not issue freely the instruction for the freezing, but 
the instruction for the freezing should be issued after 
the host computer 1010 has written all of the 

25 unreflected data on the cache or buffer memory to the 
main storage apparatus system 1180. 

Figs. 2A to 2C show the flow of the data in 
the present embodiment. 
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Fig. 2A is a schematic view showing the flow 
of the data in the state in which the host computer 
1010 has not yet issued the freezing instruction, i.e., 
in the normal state, 
5 The data which has been sent from the host 

computer 1010 is written to the main volume 1120 
(indicated by an arrow A 100). The data which has been 
newly written to the main volume 1120 is read out from 
the main volume 1120 to the main DKC 1030 to be 
10 transferred to the sub-DKC 1040 to be written to the 
sub-differential volume 1170 (indicated by an arrow B 
110) . 

At an arbitrary time point in Fig. 2A, in the 
sub-volume 1150, there is stored the same volume image 
15 as that of the main volume 1120 at a time point when 
the host computer 1010 issued the freezing instruction 
last time. 

Fig. 2B is a schematic view showing the flow 
of the data from a time point after the host computer 

20 1010 issues the freezing instruction up to a time point 
when the main DKC 1030 issues a notification command 
reporting that all of the data has been sent (herein- 
after, referred to as "all freezing data transmission 
completion", when applicable) to the sub-DKC 1040. 

25 If the data sent from the host computer 1010 

is the data which is to be stored in the block of the 
main disk unit 1130 in which data at a time point when 
the host computer 1010 issued the freezing instruction 



has already been sent to the sub-DKC 1040, it is 
written to the main volume 1120 as it is (indicated by 
an arrow C 120). On the other hand, if the data which 
has been sent from the host computer 1010 is the data 
5 to be stored in the block which is still holding the 
data not yet sent to the sub-DKC 1040, it is written to 
the main differential volume 1140 (indicated by an 
arrow D 130) . 

The block containing the data which is stored 

10 in the main volume 1120 and which is not yet sent to 
the sub-DKC 1040 at a time point when the freezing 
instruction issued from the host computer 1010 is read 
out from the main volume 112 0 to the main DKC 1030 to 
be transferred to the sub-DKC 1040 to be written to the 

15 sub-differential volume A 1170 (indicated by an arrow E 
140). 

The main DKC 1030, in accordance with the 
contents of the main bitmap 1070, transfers all of the 
difference data between the main volume 1120 and the 

20 sub-volume 1150 at a time point when the freezing 

instruction issued from the host computer 1010 to the 
sub-differential volume A 1170. After completion of 
all of the transfers, the main DKC 1030 informs the 
sub-DKC 1040 that all of the freezing data has been 

25 transferred. 

At an arbitrary time point in Fig. 2B, in the 
sub-volume 1150, there is stored the volume image 
having the same contents as those of the volume image 
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which the main volume 112 0 held at a time point when 
the host computer 1010 issued the instruction for the 
freezing last time. 

Fig, 2C is a schematic view showing the flow 
5 of the data ranging from a time point when the main DKC 
1030 informed the sub-DKC 1040 of that all of the 
freezing data has been transferred up to a time point 
when the main DKC 1030, using the data stored in the 
main differential volume 1140, updates the data stored 

10 in the main volume 1120, and also the sub-DKC 1040, 

using the data stored in the sub-differential volume A 
1170, updates the data which is stored in the sub- 
volume 1150. 

The data which has been transferred from the 

15 host computer 1010 is written to the main volume 112 0 
(indicated by an arrow F 150)* 

The data which is stored in the main volume 
1120 is updated on the basis of the data which is 
stored in the main differential volume 1140 (indicated 

20 by an arrow G 160). But, in the case where the block 
containing the data becoming an object of the update is 
already updated the data which has been transferred 
from the host computer 1010, the update of the data in 
the main volume 1120 corresponding to the data stored 

25 in the main differential volume 1140 is not carried 
out. 

The data which has been transferred from the 
host computer 1010 to the main disk unit 1130 after the 



- 23 - 

freezing instruction from the host computer 1010 is 
read out from the main volume 112 0 to the main DKC 103 0 
to be sent to the sub-DKC 104 0 to be stored in the sub- 
differential volume B 1175 (indicated by an arrow H 
5 170). 

The sub-DKC 104 0 reads out the data in the 
sub-differential volume A 1170 to the sub-DKC 1040 to 
store that data in the sub-volume 1150 (indicated by an 
arrow I 180 ) . 

10 At an arbitrary time point in Fig. 2C, the 

data stored in the sub-volume 1150 is combined with the 
data stored in the sub-differential volume A 1170, 
whereby the volume image of the main volume 1120 at a 
time point when the host computer 1010 issued the 

15 freezing instruction to the main DKC 1030 that time is 
reproduced. 

From the foregoing, in Figs. 2A and 2B, the 
data of the volume image having the same contents as 
those of the data of the volume image of the main disk 

20 unit 1120 at a time point when the freezing instruction 
was issued by the host computer 1010 last time is 
present in the sub-volume 1150. In Fig. 2C, the data 
of the volume image having the same contents as those 
of the data of the volume image in the main disk unit 

25 1120 at a time point when the freezing instruction was 
issued at that time can be reproduced by combining the 
data stored in the sub-volume 1150 with the data in the 
sub-differential volume A 1170. 
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In other words, in any case, the volume 
images which are coherent with the volume images of the 
main disk unit 1120 at a time point when the host 
computer 1010 issued the freezing instruction is 
prepared in the sub-disk unit 1160. 

Fig. 3 is a block diagram of the main DKC 

1030. 

The main DKC 1030 includes a host interface 
1210, a drive interface 1230, a network interface 1220, 
a CPU 1240, a ROM 1250, a RAM 1260, and a direct memory 
access controller 1270. 

The program which runs on the CPU 1240 is 
stored in the ROM 1250. 

The main freezing mode 1060, the main bitmap 
1070, and the main differential bitmap 1080 are stored 
in the RAM 1260. The RAM is also used as the cache 
memory. 

The CPU 1240 controls the main storage 
apparatus 1180. In the CPU 1240, a multitask operating 
system is running, so a write processing 2000, a main 
freezing processing 2600 and the like can be processed 
in parallel with one another. 

The sub-DKC 1040 has also the same configura- 
tion as that of the main DKC 1030. But, in the sub-DKC 
1040, the host interface 1210 is electrically connected 
to the sub-host computer 1020, and the drive interface 
1230 is electrically connected to the sub-disk 1160. 
In the RAM 1260, the sub-freezing mode 1090, the sub- 



bitmap 1100 and the sub-differential bitmap 1110 are 
stored. 

Fig. 4 is a flow chart of the write process- 
ing 2000 which is executed in the main DKC 1030 when 
5 the host computer 1010 sends the write command to write 
data and the data to be written ( hereinafter , referred 
to as "the write data" for short, when applicable) to 
the main storage apparatus system 1180. 

The main DKC 1030 receives the write data 

10 through the host interface 1210 (Step 2010) to judge 
whether or not the main freezing mode 1060 stored in 
the RAM 1260 is in the ON state (Step 2020). 

If it is judged in Step 2020 that the main 
freezing mode 1060 is in the OFF state, then the main 

15 DKC 1030 sets to 1 the bit of the main bitmap 1070 

corresponding to the block having the main volume 1120 
to which the write data received by the main DKC 1030 
is written (Step 2030). 

The main DKC 1030 controls the main disk unit 

20 113 0 in such a way that the write data is written to 
the main volume 1120 (Step 2040). The main DKC 1030 
itself judges whether or not a main remote copy 
processing 2200 is being executed (Step 2050). If it 
is judged in Step 2 050 that the main remote copy 

25 processing 2200 is not being executed, then the remote 
processing is completed after the main DKC 1030 has 
executed the main remote copy processing 2200. On the 
other hand, if it is judged in Step 2050 that the main 
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remote copy processing 2200 is being executed, then the 
write processing 2000 is completed. 

If it is judged in Step 2020 that the main 
freezing mode 1060 is in the ON state, then the main 
5 DKC 1030 judges whether or not the bit of the main 
bitmap 107 0 corresponding to the block to which the 
received write data is to be written is 1 (Step 2060). 
If it is judged in Step 2060 that the corresponding bit 
is zero, then the processing in Step 2030 is executed. 

10 On the other hand, if it is judged in Step 2060 that 
the corresponding bit is 1, then the bit of the main 
differential bitmap 1080 corresponding to the block in 
the main volume 1120 in which the received write data 
is to be stored is set to 1 (Step 2070). 

15 The main DKC 1030 controls the main disk unit 

113 0 in such a way that the block number information in 
the main volume 1120 is added to the received write 
data, and then the write data is written to the main 
differential volume 1140 (Step 2080), Thereafter, the 

20 processing in Step 2 050 is executed. 

Fig. 5 is a flow chart in explaining a main 
remote copy processing 2200 which the main DKC 1030 
executes . 

The main remote copy processing 2200 is the 
25 processing which is called from the above-mentioned 
write processing 2000 and from the main freezing 
processing 2600 which will be described later. 

The main DKC 1030 judges whether or not the 



corresponding bit of the main bitmap 1070 is 1 and also 
whether or not the block which contains the data stored 
in the RAM 1260 is present in the main volume 1120 
(Step 2230). If it is judged in Step 2230 that the 
5 block corresponding to the condition is present 

therein, then the main DKC 103 0 specifies the block of 
interest to execute the processing in Step 2260. 

On the other hand, if it is judged in Step 
2230 that the block corresponding to the condition is 

10 absent, then the main DKC 103 0 judges whether or not 
the bit of 1 is present in the main bitmap 1070 (Step 
2240). If it is judged in Step 2240 that the bit of 1 
is not present in the main bitmap 1070, then the main 
remote copy processing 2200 is completed. 

15 On the other hand, if it is judged in Step 

2240 that the bit of 1 is present in the main bitmap 
1070, then the main DKC 1030 specifies the block 
corresponding to the bit of 1 in the main bitmap 1070 
to read out the data in the block thus specified from 

2 0 the main volume 112 0 to store the data thus read out in 
the RAM 1260 (Step 2250). 

The main DKC 1030 makes zero the bit of the 
main bitmap 1070 corresponding to the specified block 
(Step 2260). The main DKC 1030 transfers the data, 

2 5 which has been read out, to the sub-DKC 1040 through 
the network interface 1220 (Step 2270). 

After having received the report, from the 
sub-DKC 1040, that the sub-DKC 1040 received the data 
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of interest (Step 2280), the main DKC 1030 returns back 

to the processing in Step 2230. 

Fig. 6 is a flow chart useful in explaining a 

sub-remote copy processing 2400 which the sub-DKC 1040 
5 executes at the time when the main DKC 1030 has sent 

the data to the sub-DKC 1040. 

The sub-DKC 1040 receives the data which has 

been sent from the main DKC 1030 through the network 

interface 1220 (Step 2410), and then transmits the 
10 report exhibiting the reception of the data to the main 

DKC 1030 (Step 2420) . 

The sub-DKC 1040 judges whether or not the 
value of the sub-freezing mode 1090 stored in the RAM 
1260 is 2 (Step 2430), and if it is judged in Step 2430 
15 that the value of interest is not 2, controls the sub- 
disk unit 1160 in such a way that the received data is 
written to the sub-differential value A 1170 (Step 
2440) . 

The sub-DKC 1040 makes 1 the bit of the sub- 
20 bitmap 1100 corresponding to the block having the 

written data to complete the sub-remote processing 2400 

(Step 2450) . 

On the other hand, if it is judged in Step 
2430 that the value of the sub-freezing mode 1090 is 2, 
25 then the sub-DKC 1040 controls the sub-disk unit 1160 
in such a way that the received data is written to the 
sub-differential value B 1175 (Step 2460). 

The sub-DKC 1040 sets to 1 the bit of the 



sub-differential bitmap 1110 corresponding to the block 
having the written data to complete the sub-remote copy 
processing 2400 (Step 2470). 

Fig. 7 is a flow chart useful in explaining a 
5 main freezing processing 2600 which the main DKC 1030 
executes at the time when the host computer has issued 
the freezing instruction. 

After having received the freezing instruc- 
tion from the host computer 1010 through the host 
10 interface 1210, the main DKC 1030 turns ON the main 
freezing mode 1060 which is stored in the RAM 1260 
(Step 2610) . 

The main DKC 1030 transmits the freezing 
instruction to the sub-DKC 1040 (Step 2620). The main 
15 DKC 1030 judges whether or not the main DKC 1030 itself 
is executing the remote copy processing 2200 (Step 
2625) . 

If it is judged in Step 2625 that the main 
DKC 1030 itself is executing the remote copy processing 
20 2200, then the main DKC 1030, after having carried out 
the step of waiting for some time (e.g., several 
milliseconds) (Step 2 635), executes the processing in 
Step 2640. 

On the other hand, if it is judged in Step 
25 2625 that the main DKC 1030 itself is not executing the 
remote copy processing 2200, then the main remote copy 
processing 2200 is executed (Step 2630) to execute the 
processing in Step 2640. 



in Step 2640, the main DKC 1030 judges 
whether or not all of the bits of the main bitmap 1070 
are zero. If the bit exhibiting 1 is present in the 
main bitmap 1070, then since the data to be sent to the 
sub-DKC 1040 still remains in the main disk unit 1130, 
the main DKC 1030 executes again the processings after 
Step 2625 until all of the bits of the main bitmap 1070 

have become zero- 

On the other hand, if it is judged in Step 
2640 that all of the bits of the main bitmap 1070 are 
Z ero, then the main DKC 1030 transmits the information, 
that the freezing data has already been transmitted, to 
the sub-DKC 1040 (Step 2650). 

The main DKC 1030 judges whether or not all 
of the values of the main differential bitmap 1080 are 

zero (Step 2660) . 

If it is judged in Step 2660 that all of the 
values of the main differential bitmap 1080 are not 
zero, then the main DKC 1030 controls the main disk 
, unit 1130 in such a way that the data of the block, in 
which the bit in the main differential bitmap 1080 is 
1, is read out from the main differential volume 1140 
(Step 2670) to be written to the block to which the 
main volume 1120 corresponds (Step 2680). 
5 The main DKC 1030 sets to zero the bit of the 

main differential bitmap 1080 corresponding to the 
bl ock containing the written data (Step 2690), while it 
sets to 1 the corresponding bit of the main bitmap 1070 
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processing in Step 2830. 

On the other hand, if it is judged in Step 
2 84 0 that the block in which the corresponding bit of 
the sub-bitmap 1100 is 1 is absent, then the sub-DKC 
1040 sets to zero the sub-freezing mode 1090 (Step 
2880) to transmit the report exhibiting the completion 
of the sub-freezing processing to the main DKC 1030 
(Step 2890) to complete the sub-freezing processing 
2800. 

Fig. 9 is a flow chart useful in explaining a 
sub-recovery processing 3000 which the sub-DKC 1040 
executes in accordance with the instruction from the 
sub-host computer 1020 in the case where the host 
computer 1010 and the main storage apparatus 1180 
become both unusable at all due to a disaster or the 
like. 

After having received the instruction issued 
from the sub-host computer 1020 , the sub-DKC 1040 
judges whether or not the sub-freezing mode 1090 is 1 
(Step 3010). If it is judged in Step 1040 that the 
sub-freezing mode 1090 is 1, then the sub-DKC 1040 
suspends the sub-freezing processing 2800 which the 
sub-DKC 1040 itself is executing (Step 3040) to set to 
zero the sub-freezing mode (Step 3050). 

The sub-DKC 1040 initiallizes all of the 
values of the sub-differential bitmap to zero (Step 
3060) to erase the information which the sub- 
differential volume A 1170 and the sub-differential 



volume B 1175 have (Step 3070). 

The sub-DKC 104 0 transmits the completion 
report to the sub-host computer 1020 (Step 3080) to 
complete the sub-recovery processing 3000. 
5 On the other hand, if it is judged in Step 

3010 that the sub-freezing mode 1090 is not 1, then the 
sub-DKC 1040 judges whether or not the sub-freezing 
mode 1090 is zero (Step 3020). If it is judged in Step 
3020 that the sub-freezing mode 1090 is zero, then the 

10 sub-DKC 1040 executes the processing in Step 3060. On 
the other hand, if it is judged in Step 3020 that the 
sub-freezing mode 1090 is not zero, then the sub-DKC 
1040 waits for the sub-freezing mode 1090 to become 
zero to execute the processing in Step 302 0 (Step 

15 3030). 

By executing the sub-recovery processing 
3000, the volume image of the main volume 1120 at a 
time point when the freezing instruction was issued 
from the host computer 1010 to the main DKC 1030 last 
20 time or this time is copied to the sub-volume 1150. 
Then, the sub-host computer 1020 can use freely the 
copied volume image. 

Fig. 10 is a flow chart useful in explaining 
a read processing 3200 which the main DKC 1030 executes 
25 at the time when the host computer 1010 has issued the 
read command to read the data to the main storage 
apparatus system 1180. 

After having received the read command issued 



from the host computer 1010, the main DKC 1030 judges 
whether or not the data which has been requested from 
the host computer 1010 is present in the RAM 1260 (Step 
3205) . 

5 If it is judged in Step 3 205 that the 

requested data is not present in the RAM 1260, then the 
main DKC 103 0 checks the main freezing mode (Step 
3210). If it is judged in Step 3210 that the main 
freezing mode 1060 is OFF, then the main DKC 1030 reads 
10 out the requested data from the main volume 1130 (Step 
3220) to transfer the data of interest to the host 
computer 1010 to complete the read processing 3200 

(Step 3230) . 

On the other hand, if it is judged in Step 
15 3210 that the main freezing mode 1060 is ON, then the 
main DKC 1030 judges whether or not the bit of the main 
differential bitmap 1080 corresponding to the data 
requested from the host computer 1010 is 1 (Step 3240). 

If it is judged in Step 3240 that the corre- 
20 spending bit is zero, then the main DKC 1030 executes 
the processing in Step 3220. On the other hand, if it 
is judged in Step 3240 that the corresponding bit is 1, 
then the main DKC 1030 finds out the data, which has 
been required from the host computer 1010, from the 
25 main differential volume 1140 to read out the data thus 
found out to execute the processing in Step 3230 (Step 
3250) . 

On the other hand, if it is judged in Step 



3205 that the requested data is present in the RAM 
1260 , then the main DKC 1030 executes the processing in 
Step 3230. 

Fig, 11 is a schematic view useful in 
5 explaining the transmission and the reception of the 
freezing instruction between the apparatuses included 
in the host computer 1000. 

In Fig. 11, the vertical axis represents the 
time base. Thus, it is meant that the time elapses as 
10 the position on the drawing is located more downwardly. 

The host computer 1010 issues the freezing 
instruction to the main DKC 1030, and then in response 
to the freezing instruction issued thereto, the main 
DKC 1030 issues the freezing instruction to the sub-DKC 
15 1040. 

After having transferred the volume image of 
the main volume 1120 at a time point of the reception 
of the freezing instruction to the sub-DKC 1040, the 
main DKC 1030 transmits the report showing the comple- 

20 tion of the transfer of all of the freezing data to the 
sub-DKC 1040. 

The sub-DKC 1040 reflects the data of the 
main volume 112 0 at a time point of the issue of the 
freezing instruction to the sub-volume 1150, and after 

25 completion of the reflection of the data, informs the 
main DKC 1030 of the completion of the freezing. In 
response thereto, the main DKC 1030 informs the host 
computer 1010 of the completion of the freezing. 
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By adopting the configuration of the present 
embodiment, the data which is held in the main disk 
unit at a time point when the freezing instruction is 
issued from the host computer 1010 can be held in the 
5 sub-disk unit, and hence even when the data is 

destroyed, the loss of the data can be suppressed to a 
minimum. 

In other words, the sub-storage apparatus 
system 1190 holds the data at a time point of the issue 

10 of the freezing instruction and at the same time, holds 
as the differential data the data which was written on 
and after that time point. This freezing is carried 
out at periodic intervals, whereby when the data of the 
main storage apparatus system 1180 is not able to be 

15 used due to for some cause or other, all of the data at 
a time point when it was frozen last time can be 
obtained from the sub-storage apparatus system 1190. 

In this connection, while in the present 
embodiment, the description has been given on the 

20 assumption that a plurality of volumes are present 
inside of the main disk unit 1130, the present 
invention is not intended to be limited thereto. That 
is, a plurality of disk units may be present in the 
main storage apparatus system 1180, and each of the 

25 disk units may take the function of the volume on 
itself. This is also applied to the sub-disk unit 
1160. 

Fig. 12 is a block diagram showing a 



configuration of a second embodiment of the computer 
system 1000 to which the present invention is applied. 

A point of difference of the present 
embodiment from the first embodiment is that the copy 
of the coherent volume image at the time when the 
freezing instruction has been issued from the host 
computer 1010 is generated in the main disK unit 1130 
once, and the data is transferred from the volume thus 
generated to the sub-DKC. 
, The present embodiment is also different from 

the first embodiment in that two volumes are prepared 
for the sub-storage apparatus system, and one of them 
is made the volume which is used in order to generate 

the coherent volume. 
5 The description will hereinafter be given 

with respect to points of difference from the computer 
system 1000 of the first embodiment. The parts whrch 
.ill not be described here have the same configurations 
as those of the first embodiment, and hence are 
20 designated with the same reference numerals. 

A main disk unit 1130' includes a main mam- 
volume 1300 and a main sub-volume 1310. 

In the main main-volume 1300, there is stored 
the data which has been transferred from the host 
2 S computer 1010. The main sub-volume 1310 is used when 
copying the volume image of the main main-volume 1300 
at a time point when the freezing instruction was 
issued. The blocks which the main main-volume 1300 and 
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the main sub-volume 1310 have, respectively, show one- 
to-one correspondence • 

The main DKC 1030' has a main bitmap A 1340, 
a main bitmap B 1350, and a main bitmap C 1360 all of 
5 which are contained in the RAM 1260. 

The main bitmap A 1340, when the contained 
bit is 1, with respect to the block corresponding to 
that bit, shows that the contents of the data which is 
stored in the main main-volume 1300 are different from 
10 those of the data which is stored in the main sub- 
volume 1310. 

While the main bitmap B 1350 also shows the 
difference between the main main-volume 1300 and the 
main sub-volume 1310, only the bit corresponding to the 
15 block in which after the freezing instruction has been 
transmitted from the host computer 1010, the data is 
written to the main main-volume 1300 becomes 1. 

The main bitmap C 1360 shows that there is 
the difference in the contents between the main sub- 
20 volume 1310 and a sub-main-volume 1320. 

A sub-disk unit 1160' includes the sub-main- 
volume 1320 and a sub-sub-volume 1330. 

To the sub-main-volume 1320, there is written 
the data which has been transferred from the main DKC 
25 1030'. In the sub-sub-volume 1330, there is built the 
volume image of the main main-volume 1300 at a time 
point when the freezing processing was executed last 
time. 
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A sub-DKC 1040' has a sub-bitmap A 1370 
showing the difference between the sub-main-volume 1320 
and the sub-sub-volume 1330. Then, the sub-bitmap A 
1370 is contained in the RAM 1260. In the present 
5 embodiment, the sub-freezing mode 1090 is not used. 

Figs. 13A to 13D are respectively schematic 
views showing the flow of the data corresponding to the 
present embodiment. 

In Fig. 13A, there is shown the flow of the 
10 data in the case where the host computer 1010 does not 
issue the freezing instruction. 

The data which has been transferred from the 
host computer 1010 is written to the main main-volume 
1300 (indicated by an arrow J 190). 
15 Then, it is assumed that in the sub-sub- 

volume 1330, there is stored the data of the volume 
image of the main main-volume 1300 at a time point when 
the host computer 1010 issued the freezing instruction 
last time. 

20 In Fig. 13B, there is shown the flow of the 

data for a time period ranging from a time point when a 
host computer 1010 has issued the freezing instruction 
up to a time point when the main storage apparatus 
system 1180 generates, in the main sub-volume 1310, the 

25 copy of the volume image of the main main-volume 13 00 
at a time point when the main storage apparatus system 
1180 issued the freezing instruction. 

The main disk unit 1130 copies the data from 



the main main-volume 1300 to the main sub-volume 1310 
(indicated by an arrow L 210). 

While the data which the main DKC 1030' has 
received is written to the main main-volume 13 00 
(indicated by an arrow K 200), in the case of writing 
of the data to the block in which the copy to the main 
sub-volume 1310 is not yet carried out, after comple- 
tion of the processing of copying the data indicated by 
the arrow L 210, the data is written to the main main- 
volume 1300. 

In Fig. 13C, there is shown the flow of the 
data for a time period ranging from a time point when 
the volume image of the main main-volume 1300 at a 
point when the host computer 1010 issued the freezing 
instruction has been generated in the main sub-volume 
1310 up to a time point when the volume image generated 
in the main sub-volume 1310 is generated in the sub- 
main-volume 1320 which the sub-DKC 1040' manages. 

The data which has been transferred from the 
host computer 1010 is written to the main main-volume 
1300 (indicated by the arrow M 220). The data of the 
main sub-volume 1310 is read out to the main DKC 1030' 
to be transferred to the sub-DKC 1040' to be written to 
the sub-main-volume 1320 (indicated by the arrow N 
230) . 

in Fig. 13D, there is shown the flow of the 
data for a time period ranging from a time point when 
the volume image of the main main-volume 1300 at a time 
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point when the host computer 1010 issued the freezing 
instruction to the sub-main-volume 1320 has been 
generated up to a time point when the volume image thus 
generated is copied to the sub-sub-volume 1330; 
5 The data which has been transferred from the 

host computer 1010 is written to the main main-volume 
1300 (indicated by an arrow O 240). 

The sub-DKC 1040' controls the copy of the 
data from the sub-main-volume 132 0 to the sub-sub- 

10 volume 1330 (indicated by an arrow P 250). 

In the present embodiment, the copy of the 
data for duplicating the volume image of the main main- 
volume 1300 is carried out in such a way that of the 
data which is stored in the source volume and in the 

15 destination volume, only the differential data is 
subjected to the differential copy. 

In Figs. 13A, 13B and 13C, the sub-sub-volume 
1330 holds the volume image of the main main-volume 
1300 at a time point when the host computer 1010 issued 

20 the freezing instruction last time. 

In Fig. 13D, the sub-main-volume 13 2 0 holds 
the volume image of the main main-volume 1300 at a time 
point when the host computer 1010 has issued the 
freezing instruction this time. 

25 Therefore, volume image of the main main- 

volume 1300 at a time point when the host computer 1010 
issued the freezing instruction will be held in any 
case. 
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Fig, 14 is a schematic view useful in 
explaining the flow of the freezing instruction in the 
computer system 1000 of the present embodiment. In the 
figure, the vertical direction represents the time 
5 base. Thus, it is meant that the time elapses as the 
position on the drawing is located more downwardly. 

The host computer 1010 issues the freezing 
instruction to the main DKC 1030'. In response to the 
freezing instruction issued thereto, the main DKC 1030' 

10 differential-copies (hereinafter, the differential copy 
will be referred to as "the split", when applicable) 
all of the data, which is stored in the main main- 
volume 1300 at a time point when the freezing instruc- 
tion was issued, to the main sub-volume 1310. After 

15 completion of the differential copy, the main DKC 1030' 
reads out the data of the main sub-volume 1310 to 
transmit the data thus read out to the sub-DKC 1040'. 
Then, the sub-DKC 1040' writes the data which has been 
received from the main DKC 1030' to the sub-main volume 

20 1320. 

The main DKC 1030' issues the freezing 
instruction to the sub-DKC 1040'. After having 
received the freezing instruction, the sub-DKC 1040' 
splits the volume image of the sub-main volume 1320 to 
25 the sub-sub-volume 1330. After completion of the 

split, the sub-DKC 1040' transmits the report exhibit- 
ing the completion of the freezing to the main DKC 
1030'. After having received this report, the main DKC 
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1030' informs the host computer 1010 of the completion 
of the freezing. 

Fig. 15 is a flow chart useful in explaining 
a write processing A 3400 which the main DKC 1030' 
5 executes when the host computer 1010 transmits the data 
to the main storage apparatus system 1180. 

The main DKC 1030' receives the write data 
from the host computer 1010 (Step 3410) to judge 
whether or not the main freezing mode 1060 is in the ON 

10 state (Step 3420). 

If it is judged in Step 3420 that the main 
freezing mode 1060 is in the ON state, then the main 
DKC 1030' judges whether or not the bit of the main 
bitmap A 1340 corresponding to the block in which the 

15 transferred data is stored is 1 (Step 3430). 

If it is judged in Step 3420 that the bit of 
the main bitmap A 1340 is zero, then the main DKC 1030' 
executes the processing in Step 3470. On the other 
hand, if it is judged in Step 342 0 that the bit of the 

20 main bitmap A 1340 is 1, then the main DKC 1030' 

controls the main disk unit 1130 in such a way as to 
copy the data stored in the block corresponding to the 
bit of 1 from the main main volume 1300 to the main 
sub-volume 1310 (Step 3440). 

25 After completion of the copy, the main DKC 

1030' sets to zero the corresponding bit of the main 
bitmap A 1340 (Step 3450) and also sets to 1 the 
corresponding bit of the main bitmap C 1360 (Step 



3460) . 

The main DKC 1030' sets to 1 the bit of the 
main bitmap B 1350 corresponding to the block in which 
the transferred data is stored (Step 3470) to write the 
5 write data to the corresponding block of the main main- 
volume 1300 to complete the write processing A 3400 
(Step 3480) . 

On the other hand, if it is judged in Step 
3420 that the main freezing mode is in the OFF state , 
10 then the main DKC 1030' sets to 1 the corresponding bit 
of the main bitmap A to execute the processing in Step 
3480 (Step 3490) . 

Fig. 16 is a flow chart useful in explaining 
the main freezing processing A 3600 which the main DKC 
15 1030' executes when the host computer 1010 has issued 
the freezing instruction to the main DKC 1030'. 

After having received the freezing instruc- 
tion from the host computer 1010 (Step 3610), the main 
DKC 1030' makes the ON state the main freezing mode 
20 (Step 3620) to judge whether or not all of the bits of 
the main bitmap A 11340 is zero (Step 3630). 

If it is judged in Step 3630 that all of the 
bits of the main bitmap A 1340 are not zero, then the 
main DKC 1030' specifies the block in which the bit is 
25 1 in the main bitmap A 1340 (Step 3640). Then, the 
main DKC 1030' reads out the specified block of the 
main main volume 1300 to control the main disk 1130' in 
such a way as to copy the block thus read out to the 
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main sub-volume 1310 (Step 3650). 

After completion of the copy of the specified 
block, the main DKC 1030 ' sets to zero the correspond- 
ing bit of the main bitmap A 1340 (Step 3660), while 
5 sets to 1 the corresponding bit of the main bitmap C 
1360 to return back to the processing in Step 3630 
(Step 3670) . 

If it is judged in Step 3630 that all of the 
bits of the main bitmap A 1340 are zero, then the main 
10 DKC 1030' judges whether or not all of the bits of the 
bitmap C1360 are zero (Step 3680). 

If it is judged in Step 3 680 that all of the 
bits of the main bitmap C1360 are not zero, then the 
main DKC 1030' selects the bit as 1 of the main bitmap 
15 C 1360 (Step 3690) to read out the block corresponding 
to the bit of the main sub-volume 1310 to transmit the 
block thus read out to the sub-DKC 1040' (Step 3700). 

The main DKC 1030' sets to zero the corre- 
sponding bit of the main bitmap C 1360 to return back 
20 to the processing in Step 3680 (Step 3710). 

On the other hand, if it is judged in Step 
3680 that all of the bits of the main bitmap C 1360 are 
zero, then the main DKC 1030' issues the freezing 
instruction to the sub-DKC 1040' (Step 3720) to wait 
25 for the report exhibiting the freezing completion to be 
transmitted thereto from the sub-DKC 1040' (Step 3730). 

After having received the report exhibiting 
the completion of the freezing from the sub-DKC 1040' 
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(Step 3740), the main DKC 1030' copies the contents of 
the main bitmap B 1350 to the main bitmap A 1340 (Step 
3750) to set to zero all of the bits of the main bitmap 
B 1350 (Step 3760). The main DKC 1030' makes the OFF 
state the main freezing mode 1060 (Step 3770) to 
transmit the report exhibiting the freezing completion 
to the host computer 1010 to complete the main freezing 
processing A 3600 (Step 3780). 

Fig. 17 is a flow chart useful in explaining 
the sub-remote copy processing A 3800 which the sub-DKC 
1040 executes when the processing of the remote copy is 
executed for the sub-DKC 1040 in Step 3700 of the main 
freezing processing A 3600. 

After having received the data from the main 
DKC 1030' (Step 3810), the sub-DKC 1040 controls the 
sub-disk unit 1160 in such a way that the received data 
is written to the corresponding block of the sub-main- 
volume 1320 (Step 3820). 

After the processing of writing the data has 
, been completed, the sub-DKC 1040 sets to 1 the corre- 
sponding bit of the sub-bitmap A 1370 to complete the 
sub-remote copy processing A 3800 (Step 3830). 

Fig. 18 is a flow chart useful in explaining 
a sub-freezing processing A 4000 which the sub-DKC 
5 1040' executes when the main DKC 1030' has issued the 
freezing instruction to the sub-DKC 1040'. 

The sub-DKC 1040' which has received the 
freezing instruction from the main DKC 1030' judges 



- 48 - 

whether or not all of the bits of the sub-bitmap A 1370 
are zero (Step 4010). 

If it is judged in Step 4010 that all of the 
bits of the sub-bitmap A 1370 are not zero, then the 
5 sub-DKC 1040' controls the sub-disk unit 1160' in such 
a way that it selects the block of the sub-main-volume 
1320 corresponding to the bit as 1 of the sub-bitmap A 
1370 (Step 4020) to read out the block thus selected to 
copy the block thus read out to the corresponding block 

10 of the sub-sub-volume 1330 (Step 4030). 

After completion of the copy of the corre- 
sponding block, the sub-DKC 1040' sets to zero the 
corresponding bit of the sub-bitmap A 137 0 to return 
back to the processing in Step 4010 (Step 4040). 

15 On the other hand, if it is judged in Step 

4010 that all of the bits of the sub-bitmap A 1370 are 
zero, then the sub-DKC 1040' transmits the report 
exhibiting the completion of the freezing to the main 
DKC 1030' to complete the sub-freezing processing A 

20 4000 (Step 4050). 

In the present embodiment, since the data of 
the volume image of the main main-volume 1300 at a time* 
point when the host computer 1010 issued the freezing 
instruction last time is stored in either the sub-sub- 

25 volume 1330 or the sub-main-volume 1320, the processing 
corresponding to the sub-recovery processing 3000 
become unnecessary. 

When the read request has been made from the 
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host computer 1010 , the processing(s) as in the first 
embodiment does (do) not need to be executed, and the 
data of the main main-volume 1300 has only to be 
transferred. 

Fig. 19 is a block diagram showing a configu- 
ration of a third embodiment of the computer system 
1000 to which the present invention is applied. 

In the present embodiment, a point that the 
remote copy is carried out only in Fig. 13C of Figs. 
13A to 13D and hence the network can not be used 
effectively in the second embodiment is improved. 

The description will hereinafter be given 
with respect to only a point of difference from the 
second embodiment. 

A main DKC 1030" has a main bitmap D 1380 
which the RAM 1260 includes. 

The main bitmap D 1380 shows the data which 
is not yet copied to the main sub-volume 1310 and which 
is stored in the main main-volume 1300, i.e., the block 
containing that data which was remote-copied to the 
sub-main-volume 1320 before issue of the freezing 
instruction. 

A sub-DKC 1040" has a sub-bitmap B 13 90. 
The sub-bitmap B 1390 shows the block which 
is remote-copied from a main DKC 1030" to the sub-main 
volume 1320 on and after the freezing instruction has 
been issued this time but before the freezing instruc- 
tion will be issued next time. 
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In the present embodiment, the main freezing 
mode takes the integral number from 0 to 3. The sub- 
freezing mode shows either ON or OFF. 

Figs. 20A to 20D are respectively schematic 
5 views showing the flow of the data in the computer 
system 1000 of the present embodiment. 

The description will hereinafter be given 
with respect to the present embodiment while comparing 
the present embodiment with Figs. 13A to 13D showing 
10 the flow of the data in the computer system 1000 to 
which the second embodiment is applied. 

In Fig. 2 OA, the data which has been written 
from the host computer 1010 to the main main-volume 
1300 is transferred to the sub-DKC 1040" before the 
15 host computer 1010 issues the freezing instruction 
(indicated by an arrow R 270). An arrow Q 260 
corresponds to the arrow J 190 shown in Fig. 13A. 

An arrow S 280 and an arrow T 290 in Fig. 2 0B 
show the flow of the data corresponding to the arrow K 
20 200 and the arrow L 210 in Fig. 13B, respectively. 

The data which has already been copied 
(indicated by the arrow T 2 90) to the main sub-volume 
1310 but which is not yet sent to the sub-main-volume 
1320 is transferred from the corresponding block of the 
25 main sub-volume 1310 to the sub-DKC 1040" through the 
main DKC 1030" to be written to the sub-ma in- volume 
1320 (indicated by an arrow K 300). 

An arrow V 310 and an arrow W 320 shown in 
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Fig. 20C correspond to the arrow M 220 and the arrow N 
230 shown in Fig. 13C, respectively. 

An arrow X 330 and an arrow Z 350 shown in 
Fig. 20D correspond to the arrow O and the arrow P 
5 shown in Fig. 13, respectively. 

The data which has been newly written to the 
main main-volume 1300 (indicated by the arrow X 330) is 
copied to the sub-main-volume 1320 (indicated by an 
arrow Y 340) before the host computer 1010 issues the 
10 next freezing instruction. 

In the case where the data for the block 
which is not yet copied from the sub-main-volume 1320 
to the sub- sub-volume 1300 has been received from the 
main DKC 1030" by the sub-DKC 1040", the sub-DKC 1040" 
15 copies the data in the block corresponding to the data 
which has been received once from the sub-main-volume 
1320 to the sub-sub-volume 1330 (indicated by the arrow 
Z 350). Thereafter, the sub-DKC 1040" controls the 
sub-disk unit 1160' in such a way that the data is 
20 written to the corresponding block of the sub-main- 
volume 1320. 

Fig. 21 is a schematic view useful in 
explaining the flow of the freezing instruction in the 
computer system 1000 to which the present embodiment is 
25 applied. In the figure, the vertical direction 

represents the time base, and hence the time elapses as 
the position on the drawing is located more downwardly. 

Comparing Fig. 21 with Fig. 14, it is under- 
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stood that a point of difference is that the remote 
copy is carried out for a longer time period. 

Fig. 22 is a flow chart useful in explaining 
a write processing B 4200 which the main DKC 1030" 
5 executes when the data has been transferred from the 
host computer 1010 to the main storage apparatus system 
1180. 

The main DKC 1030" receives the write data 
from the host computer 1010 (Step 4210) to judge 

10 whether or not the main freezing mode 1060 is zero 
(Step 4220). If it is judged in Step 4220 that the 
main freezing mode 1060 is not zero, then the main DKC 
1030" judges whether or not the main freezing mode 1060 
is 1 (Step 4230) . 

15 If it is judged in Step 4230 that the main 

freezing mode 1060 is not 1, then the main DKC 1030" 
judges whether or not the main freezing mode 1060 is 2 
(Step 4240) . 

If it is judged in Step 4240 that the main 

20 freezing mode 1060 is 2, then the main DKC 1030" 

executes the processing in Step 4260. On the other 
hand, if it is judged in Step 4240 that the freezing 
mode 1060 is not 2 (i.e., it is judged to be 3), then 
the main DKC 1030" sets to zero the bit of the main 

25 bitmap D 1380 corresponding to the transferred block 
(Step 4250). 

The main DKC 1030" sets to 1 the bit 
corresponding to the write data of the main bitmap A 



1340 (Step 4260) and controls the main disk unit 1130" 
in such a way that the write data is stored in the 
corresponding block of the main main-volume 1300 to 
complete the main write processing B 4200 (Step 4270). 
5 On the other hand, if it is judged in Step 

4220 that the main freezing mode 1060 is zero, then the 
main DKC 1030" sets to zero the corresponding bit of 
the main bitmap C 1380 to execute the processing in 
Step 4250 (Step 4280), 

10 In addition, if it is judged in Step 423 0 

that the main freezing mode 1060 is 1, then the main 
DKC 1030" judges whether or not the corresponding bit 
of the main bitmap A 1340 is 1 (Step 4290). If it is 
judged in Step 4290 that the corresponding bit is zero, 

15 then the main DKC 1030" executes the processing in Step 
4330. On the other hand, if it is judged in Step 4290 
that the corresponding bit is 1, then the main DKC 
1030" controls the main disk unit 1160' in such a way 
that the data of the block of the main main-volume 1300 

20 corresponding to the bit of interest is copied to the 
corresponding block of the main sub-volume 1310 (Step 
4300) . 

The main DKC 1030" sets to zero the bit of 
the main bitmap A 1340 corresponding to the copied data 
25 (Step 4310). The main DKC 1030" sets to 1 the bit of 
the main bitmap C 1360 corresponding to the copied data 
(Step 4320). In addition, the main DKC 1030" sets to 1 
the bit of the main bitmap B 1350 corresponding to the 
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copied data (Step 4330, to return back to the process- 

ing in Step 427 0. 

rig. 23 is a flow chart useful in explaining 

a main freezing processing B 4400 which the main DKC 
5 1030" executes when the host computer 1010 has issued 
the freezing instruction to the main DKC 1030- . 

After having received the freezing instruc- 
tion from the host computer 1010 (Step 4410), the main 
DKC 1030" sets to 1 the main freezing mode 1060 to 
!„ complete the main freezing processing B 4400 (Step 

4420> ' Fig. 24 is a flow chart useful in explaining 
a main copy processing 4600 which is activated by the 
main DKC 1030" at the tl_ when turning ON the power 
15 source of the main storage apparatus system 1180, and 

thereafter the main DKC 1030" continues to execute as 

one task. 

The main DKC 1030" judges whether or not the 
main freezing mode 1060 is 1 (Step 4610). If it is 
2 „ judged in Step 46!0 that the main freezing mode 1060 rs 
1 then the main DKC 1030" judges whether or not the 
bit of 1 is present in the bits contained in the main 

bitmap A 1340 (Step 4620). 

If it is judged in Step 4610 that the bit of 
25 i is present in the bits contained in the main bitmap A 
1340, then the main DKC 1030" controls the main disk 
unit 1130" in such a way that the block corresponding 
to the bit of interest is selected (Step 4630), and the 
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data of the block corresponding to the bit of the main 
main volume 1300 thus selected is copied to the 
corresponding block of the main sub-volume 1310 (Step 
4640). 

After completion of the copy, the main DKC 
103 0" sets to zero the corresponding bit of the main 
bitmap A 1340 (Step 4650), while sets to 1 the corre- 
sponding bit of the main bitmap C 1360 to return back 
to the processing in Step 4620 (Step 4660). 

On the other hand, if it is judged in Step 
4610 that the main freezing mode is not 1, then the 
main DKC 1030" executes the processing in Step 4680. 

In addition, if it is judged in Step 462 0 
that the bit of 1 is absent in the main bitmap A 1340, 
then the main DKC 1030" sets to 2 the main freezing 
mode 1060 (Step 4670), and carries out waiting for some 
time to return back to the processing in Step 4610 
(Step 4680) . 

Fig. 25 is a flow chart useful in explaining 
a main remote copy processing 4800 which is activated 
by the main DKC 1030" at the time when turning ON the 
power source of the main source apparatus system and 
which the main DKC 1030" executes as one task. 

The main DKC 1030" judges whether the main 
freezing mode 1060 is zero or 3 (Step 4810). If it is 
judged in Step 4810 that the main freezing mode 1060 is 
zero or 3, then the main DKC 1030" judges whether or 
not the block in which the bit of the main bitmap A 
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volume 1310 to transfer the block thus read out to the 
sub-DKC 104 0 M (Step 4910). 

The main DKC 103 0" receives the report 
exhibiting the reception of the data from the sub-DKC 
5 1040" to return back to the processing in Step 4810 
(Step 4920) . 

On the other hand f if it is judged in Step 
4880 that the block is not present in which the main 
bitmap C 1360 is 1 and also the main bitmap D 13 80 is 
10 zero, then the main DKC 1030" judges whether or not the 
main freezing mode 1060 is 2 (Step 4930). 

If it is judged in Step 4930 that the main 
freezing mode 1060 is 2, then the main DKC 1030" clears 
all of the bits in the main bitmap D 1380 to zero (Step 
15 4940) f and sets to 3 the main freezing mode 1060 (Step 
4950) and then issues the freezing instruction to the 
sub-DKC 1040" to return back to the processing in Step 
4810 (Step 4960) . 

On the other hand, if it is judged in Step 
20 4930 that the main freezing mode 1060 is not 2, then 
the main DKC 1030" carried out the step of waiting for 
some time (for about several milliseconds) to return 
back to the processing in Step 4810 (Step 4970). 

Fig. 26 is a flow chart useful in explaining 
25 a main freezing completion processing 5000 which the 
main DKC 1030" executes at the time when having 
received the report exhibiting the completion of the 
freezing from the sub-DKC 1040". 
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After having received the report exhibiting 
the freezing completion from the sub-DKC 1040" (Step 
5010), the main DKC 103 0" sets to zero the main 
freezing mode 1060 (Step 5020) and informs the host 
5 computer 1010 of the freezing completion to complete 
the main freezing completion processing 5000 (Step 
5030) . 

Fig. 27 is a flow chart useful in explaining 
a sub-freezing processing 5200 which the sub-DKC 1040" 

10 executes at the time when the main DKC 1030" has issued 
the freezing instruction to the sub-DKC 1040". 

After having received the freezing instruc- 
tion from the main DKC 1030" (Step 5210), the sub-DKC 
1040" makes the ON state the sub-freezing mode 1090 

15 (Step 5220) to judge whether or not the bit of 1 is 
present in the sub-bitmap A 1370 (Step 5230). 

If it is judged in Step 5230 that the bit of 
1 is present in the sub-bitmap A 137 0, then the sub-DKC 
1040" controls the sub-disk unit 1160' in such a way 

2 0 that the block corresponding to the bit of interest is 
selected (Step 5240), and the block thus selected of 
the sub-ma in- volume 1320 is read out to be copied to 
the corresponding block of the sub-sub-volume 1330 
(Step 5250). 

25 The sub-DKC 1040" sets to zero the corre- 

sponding bit of the sub-bitmap A 1370 to return back to 
processing in Step 5230 (Step 5260). 

On the other hand, if it is judged in Step 



5230 that the bit of 1 is absent in the sub-bitmap A 
1370, then the sub-DKC 1040" copies the sub-bitmap B 
1390 to the sub-bitmap A 1370 (Step 5270) to make all 
of the bits of the sub-bitmap B 13 90 to zero (Step 
5 5280). 

The sub-DKC 1040" makes the OFF state the 
sub-freezing mode 1090 (Step 5290) and informs the main 
DKC 1040" of the freezing completion to complete the 
sub-freezing processing 5200 (Step 5300). 

10 Fig. 2 8 is a flow chart useful in explaining 

a sub-remote copy processing B 5400 which the sub-DKC 
1040" executes at the time when in Step 4910 in the 
main remote copy processing B 4 800 , the main DKC 1030 
remote-copies the data to the sub-DKC 1040". 

15 After having received the data from the main 

DKC 1030" (Step 5410) , the sub-DKC 1040" informs the 
main DKC 1030" of the reception of the data (Step 
5420) . 

Thereafter, the sub-DKC 1040" judges whether 
20 or not the sub-freezing mode 1090 is in the ON state 
(Step 5430). If it is judged in Step 5430 that the 
sub-freezing mode 1090 is in the ON state, then the 
sub-DKC 1040" judges whether or not that the bit of 1 
is present in the sub-bitmap A 1370 (Step 5440). If it 
25 is judged in Step 5440 that the bit of 1 is absent in 
the sub-bitmap A 1370, then the sub-DKC 1040" executes 
the processing in Step 5470. 

On the other hand, if it is judged in Step 
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5440 that the bit of 1 is present in the sub-bitmap A 
1370, then the sub-DKC 1040" controls the sub-disk unit 
1160 M in such a way that the block of the sub-main- 
volume 1320 corresponding to the bit of 1 is read out 
5 to be copied to the corresponding block of the sub-sub- 
volume 1330 (Step 5450). 

The sub-DKC 104 0" sets to zero the corre- 
sponding bit of the sub-bitmap A 1370 (Step 5460) , 
while sets to 1 the corresponding bit of the sub-bitmap 

10 B 1390 (Step 5470). The sub-DKC 1040" controls the 
sub-disk unit 1160' in such a way that the received 
data is written to the sub-main volume 1320 to complete 
the sub-remote copy processing B 5400 (Step 5480). 

On the other hand, if it is judged in Step 

15 5430 that the sub-freezing mode 1090 is in the OFF 

state, then the sub-DKC 1040" makes 1 the corresponding 
bit of the sub-bitmap A 1370 to execute the processing 
in Step 5480 (Step 5490). 

In the present embodiment, since the volume 

20 image of the main main-volume 1300 at a time point when 
the host computer 1010 issued the freezing instruction 
last time is held in the form of the data stored in the 
sub-sub-volume 1330 or in the form of the combination 
of the data which is stored in the sub-sub-volume 133 0 

25 and the sub-main-volume 1320, the processing corre- 
sponding to the sub-recovery processing 3000 becomes 
unnecessary. 

When the request to read the data has been 
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made from the host computer 1010, the data of the main 
main-volume 1300 may be transferred thereto. 

Next, a fourth embodiment of the present 
invention will hereinafter be described, 
5 A point of difference of the fourth embodi- 

ment from other embodiments is that the data which is 
transferred from the main storage apparatus system 1130 
to the sub-storage apparatus system 1160 is encrypted. 

The fourth embodiment will now be described 
10 on the basis of the second embodiment. But, it goes 
without saying that in the first embodiment and the 
third embodiment as well, the present embodiment can be 
adopted. 

in the present embodiment, when the data is 
15 transferred from the main main-volume 1300 to the main 
sub-volume 1310, the data to be transferred is 
encrypted ( encoded ) . 

In addition, the encrypted data is trans- 
ferred from the main sub-volume 1310 to the sub-main- 
20 volume 1320, and when the encrypted data is copied from 
the sub-main-volume 1320 to the sub-sub-volume 1330, 
the data of interest is decoded. 

As a result, the encrypted data will be 
transferred on the network 1050. The description will 
25 hereinbelow be given with respect to a point of differ- 
ence from the second embodiment. 

In the present embodiment, in Fig. 13B, the 
data is copied from the main main-volume 1300 to the 
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safety of the data which is being transferred. 

By adopting the configuration of the present 
invention, even when the remote copy of no guarantee to 
order is carried out, the volume image having excellent 
5 coherency can be ensured. 

While the present invention has been particu- 
larly shown and described with reference to the 
preferred embodiments, it will be understood that the 
various changes and modifications will occur to those 
10 skilled in the art without departing from the scope and 
true spirit of the invention. The scope of the 
invention is therefor to be determined solely by the 
appended claims. 



